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Abstract 

Delayed interactions are a common property of coupled natural systems. For instance, signals in 
neural or laser networks propagate at finite speed giving rise to delayed connections. Such systems 
are often modeled by delay differential equations with discrete delays. We show that by a selective 
timeshift transformation it is often possible to reduce the number of different delays. We identify 
dynamic invariants of this transformation, determine its capabilities to reduce the number of delays 
and interpret these findings in terms of the topology of the underlying graph. In particular, we 
show that networks with identical generalized round-trip times along the fundamental semicycles 
are dynamically equivalent. 
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Time delays play an important role in networks of coupled dynamical systems. For in- 
stance, in neuronal networks l|-l5| delays occur due to the finite propagation times along the 
axons or to reaction times at chemical synapses. Similarly, the propagation of light between 



interacting lasers |6|-|8[ may cause significant time delays. Depending on the physiological 
properties of axons and synapses, the delays of signals between different cells in the network 
differ and in practice there are as many different delays in the network as there are links 
between single neurons. Such a diversity of delays was shown to enable the design of robust 
patteru generating systems Q. Q and to play an .mportant role in neural proeess.ng of 
temporal information Hence, to study such natural systems, one would need to study 
models involving numerous different delays. Independently of the physical origin, dynamics 
in networks of interacting systems can often be described by the equations 



i^jit) = fj ixj{t),{Xk (t-Tjk)) 



k&P, 



(1) 



where Xj{t), j = 1, . . . ,N, denotes the dynamics of a node j and Pj is the set of all other 
nodes of the network connected to the node j. For instance, Xj may be considered as a 
dynamical variable describing the dynamics of one neuron in the network. Taking into 
account finite time delays Tjk, which occur due to the signal propagation time from a node 
k to the node j, the coupling terms contain all variables Xk which are connected to Xj with 
corresponding time delays Tjk- Here we consider directed networks, thus one may generally 
have Tjfc 7^ t^j or even k G Pj while j ^ P^. We assume that the network is connected and 
hence, the number L of links is larger than — 1. 

For a network of systems, up to A^^ different time delays may occur in ([1]). By allowing 
several connections from one system to another, the number of delays can increase even more. 
This creates immense challenges for the analysis of the system, since every single delay may 
alter the properties and d yna mic s sig nificantly 



121-116]. The interaction of several delays is 



even more complicated SMlOl llTl . |18] and not fully understood so far. 

In this Letter we show how the number of different delays can be reduced. It appears 
that any connected network possesses a characteristic number of delays which is essential for 
describing the dynamics. This number of essential delays equals the cycle space dimension 
C = L — {N — 1) of the underlying graph and is usually smaller than the number of distinct 
Tjk- We show that the essential delays correspond to generalized round-trip times along 
fundamental semicycles in the network. Networks which have the same local dynamics and 
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the same set of essential delays can be considered as equivalent from the dynamical point of 
view. 

As a simple illustrative example, let us consider a ring of unidirectionally coupled systems 

x,(t) = /(a;,(t),x,+i(t-r,)) (2) 



with inhomogeneous coupling delays tj . It is known 19|, |20[ that this system can be reduced 
to the ring where all time delays are equal to r = ^Tj. This can be done by a separate 
time-shift transformation for each node 

{t) = xj {t + 7],) , l<j<N. (3) 

Indeed, the transformed variables yj (t) fulfill 

Vj (t) = f iVj (t) , Vj+i - -Tj + Vj - Vj+i)) , 

and if the shifts rjj are chosen appropriately, all hitherto distinct delays become the same 
while their sum along the ring, the round-trip time Nt, is preserved. This homogenization of 
delays was applied to simplify the analysis of the solutions in systems (l2l) with inhomogeneous 



delays 20|,|2]J|. Conversely, the same transformation was applied to design pattern generators 
jol, [lo| starting from the system with homogeneous delays. Our aim is to use the time- 
shift transformation ([3]) to reduce the number of different delays in networks with arbitrary 
topology. 

Applying ([3]) to ([1]), we obtain the new system 

yj (t) = fi (Vj (t) , iVk {t - fjk))kep') (4) 



with fjk = Tjk + rji: —rjj. We proceed by exploring possible delay reductions in basic network 
motifs, which consist of exactly one semicycle (a cycle in the underlying undirected graph) 
and are depicted in Fig. [H 

Motif I. Dynamics on network I is described by the system of equations 

xi [t) = h {xi it)) , 

The transformation ([3]) leads to the same system for yj but with different delays fj = 
Tj + rii—ri2, j = 1, 2. Without loss of generality we assume Ti < r2. By choosing r/2 — ?7i = Ti, 




(II) 1 (III) 



Figure 1: Simple motifs consisting of one semicycle. 

we obtain fi = and f2 = T2 — ti > 0. Thus, the transformed system contains only one 
delayed connection - the other one becomes instantaneous. In case Ti = T2 we obtain 
^1 = ^2 = 0, which means that both delays can be eliminated. Thus, the dynamics in motif 
I for Ti 7^ T2 can be described by a system with just one delay, and for ri = r2 the system 
reduces to an ordinary differential equation. Note that the quantity f2 — fi = T2 — T1 remains 
invariant. 

Motif II. After applying transformation ([3]) to motif II, the delays change to Ti = Ti + 
?7i — ?72, f2 = r2 + ?7i — ?73, fs = Ta + ?72 — 773. It is easy to check that by appropriate choice 
of rjj one obtains a system of equations with a single delay. For instance, it can be done by 
requiring that all new delays are identical fi = f2 = fa = r. In this case the delay time is 
r = Ti — r2 + Ta. The corresponding time shifts can be chosen as r/i = /i, 772 = /i + T2 — ra, 
?73 = /i + 2t2 — Ti — Ta with an arbitrary constant /i. Simple calculations give five different 
reductions to a single delay as shown in Table HI Note that some of the reductions lead to 
negative delays in the resulting network, which should be avoided since the dynamics in 



such systems are unstable [2^. For example, in the case r = ri — r2 + Ta < there is only 
one suitable reduction (fi = fa = and f2 = — r). Summarizing, the motif II always admits 
a reduction to one delay T = \ti — T2 + t-^\ = |fi — f2 + fal- This invariant quantity can 
be considered as a generalized round-trip time, taking into account the directionality of the 
connections. In the case r = the delays can be eliminated. 

Motif III. Similarly, for the motif III [Fig. [TJ-III], one can reduce the four different delays 
■7"i;T2, T3, and T4 to a single delay r. Formally, ten different combinations are possible, which 
are listed in Table [l](c). As in the case of motif I a reduction to uniform delays at each 
link is impossible for this case. But, as in the other examples, a reduction to a system 
with only one delayed connection can be achieved. Further, the generalized round-trip 
T = \ti — T2 — T3 + T^l is preserved for any reduction. When this round-trip is zero, all 
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(a): motif I 
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(b): motif II 
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(c): motif III 
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Table I: Possible reductions to a single delay in motifs I, II, and III [see Fig. [T]. The values of the 
delay r are as follows: r = ri — r2 (a), r = ri — r2 + T3 (b), r = ri — r2 — T3 + r4 (c). In each case, 
the generalized round-trip is given by T = [r|. 

delays can be eliminated. 

General networks. The cases considered above suggest that the generalized round-trip 
time along a semicycle in the network remains invariant under the time shift transformation 
([3]). Indeed, this holds for arbitrary networks. Let us first define a semicycle c = {ii, ...,ik) 
of a directed graph as a closed undirected path, which is represented as an ordered set of 
its constituting links. Then we define the generalized round-trip time T (c) along a given 
semicycle c = {ii, ...,£k) as follows 

k 

T{c):= $^r,r(£, 



(5) 



Here r (ij) is the time delay along the link ij and Tj is either +1 or —1 depending on the 
direction of the link ij with respect to an arbitrary but fixed orientation of the semicycle. 
Note that the orientation can be chosen in two different ways, which corresponds to opposite 
signs of Tj. The obtained value for T (c) is independent of the choice of orientation. 

It is possible to prove that there is a choice of timeshifts rij and a set S* = {ii, ...,iN-i} 
of N — 1 links, such that the delays fjk = Tjk — r]j + r]k in the transformed equation (jl]) are 
zero on all links contained in 5* and non- negative on all other links. In fact, the set S is 
a spanning tree; a set of — 1 links which does not contain any semicycle. The addition 
of any link i ^ S results in a set S" = S* U {£} which contains exactly one semicycle. This 
is the fundamental semicycle corresponding to £. The transformed delay f {£) on the link i 
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Figure 2: (a) A network with cycle space dimension C = 5. A spanning tree S [solid links] and 
one of its fundamental cycles, c{l) [blue dotted path], are displayed. The ib-signs indicate the 
value of the corresponding coefficients Tj in the the round-trip T(c(^)), see (b) A network of 
= 6 cells with cycle space dimension C = 3. We depict a spanning tree [solid links] and three 
corresponding fundamental cycles which are indicated by differently dashed paths. The numbers 
refer to an indexing of the links which is used in the text. According to our results, any admissible 
dynamics in this network involves at most three different interaction delays. 

equals the round-trip delay of this fundamental semicycle [Fig.|2]^a)]. To prove this claim one 
can inductively construct timeshifts and the corresponding spanning tree, which contains 
instantaneous links. Details will be presented elsewhere [23]. Consequently, the number of 
delays in the transformed system can be reduced to at most 

C = L-{N-1). (6) 

I — I 

The number C has a well known meaning for network graphs [24]: It is the cycle space 
dimension which is defined as the maximal number of independent cycles. Here, a set of 
cycles is called independent if neither of the cycles is obtained as a sequence of the other 
ones in the set. For instance, in the network given in Fig. [2](a) the cycle space dimension is 
C = 5 and in the one depicted in (b) it is C = 3. 

We call C the essential number of delays since it is the minimal number of different delays 
to which the number of delays in a network can be reduced generically. Here, generically 
means that the conditions which allow for further reduction of delays form a nuUset in the 



parameter space of delays M>q = {rjk \ Tjk > 0} of the original system ([T]) 23|. 

Dynamical invariants. There is a natural correspondence between solutions of the original 
system ([1]) and the transformed system (jl]): Any solution x (t) = {xj (^))i<j<jv © can 
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Figure 3: Equivalent stable solutions of unidirectional rings of four Mackey-Glass oscillators ([7]) 
with distinct single delays but equal round-trip. In each row, the time evolution of the j-th cell 
is indicated by the coloring. In (a), the delays are homogeneous, Tjj+i = 25. Chart (b) shows 
the corresponding solution of the transformed system with delays Tj-.j+i = Tjj+i — rjj + r/j+i and 
rj = (-5.8,0, -5.6, -18.4). Other parameters: (3 = 0.2, 7 = 0.1, c = 4. 

be identified with its transformation, y [t) = [xj [t + Vj))i<j<N^ which is a solution of @, 
see Fig. [3l As a result, many important properties of solutions like stability, frequency of 
oscillation, amplitude, etc., remain the same within a class of equivalent systems. They 
depend only on a set of generalized round-trip time delays, but not on the specific delays 
Tjk- As a consequence it is possible (and favorable) to perform bifurcation analysis in the 
reduced parameter space. Practically, one considers round-trips on a set of fundamental 
semicycles instead of single delays as parameters of the system. 

The following example is intended to provide an idea of possible applications and merits 
of the results presented in this article. Let us consider the network of Mackey-Glass systems 



26| 



X, it) = -70:, it) + 

where the summation is performed over all coupled nodes k E Pj. The coupling topology is 
shown in Fig. |2]^b). The parameters are fixed to 7 = 0.1, c = 0.525 and /3 = 0.2. Although 
the total number of delays is 8, one can parametrize all of them by the three round-trips 
T{cj), j = 1,2,3, on the fundamental semicycles [Fig. El^b)]. For further investigation we 
fix T (ca) = 7 and T (02) = 10 wherever only T (ci) is varied. 

Firstly, the delays in the network were set up randomly in such a way that the round-trips 
were preserved with T (ci) = 5. For each realization of delays, the system was integrated 
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numerically with constant initial conditions [see caption to Fig.H]. The empirical distribution 
of the individual delays and the observed attractors is shown in Fig. Hl^b). One can observe 
two attractors, one equilibrium and one periodic solution, which exist independently of the 
choice of single delays. They can be identified by their componentwise supremum norm 



obtain the bifurcation diagram with respect to T (ci) [Fig. lU^a)]. For T (ci) = 0, two stable 
equilibria are the only attractors for the system. The lower equilibrium looses stability 
in a Hopf bifurcation (H) and the emergent periodic solution undergoes a period doubling 
bifurcation (PI) which connects to a reverse period doubling at (P2). Snaking of the main 
branch accompanied by period doubling bridges and divergent periods indicates the presence 
of a homoclinic saddle-focus f27|. A step further can be done by a two-parametric bifurcation 
diagram [Fig. IH^c)]. There, the Hopf bifurcation (H) was followed numerically in the region 
< T (ci) < 500 and < T (02) < 500. Allthough the same diagram might have been 
obtained accidentally by studying variations of the delays and T7, its proper meaning as 
a diagram of codimension one is first made accessible by the presented results. 

Discussion. We have presented a universal method for the reduction of discrete 
interaction-delays in networks of dynamical systems. It turned out that the cycle space 
dimension of the network equals the number of essential delays which determine the dy- 
namics. The networks whose generalized round-trip times along the fundamental semicycles 
coincide, form a class of dynamically equivalent systems. This is an important step towards 
the systematization and classification of dynamics on networks with many different delays. 
Note that all results which are presented in this paper can be extended straightforwardly to 
networks with multiple links from one cell to another (see, for instance, motif I in Fig. [1]) 
and to other types of local dynamics like time-discrete systems or evolution equations. 

We thank K. Knauer and M. Zaks for useful discussions and the DFG for financial support 
in the framework of the Collaborative Research Center SFB910. 
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Bifurcation diagram for T(ci) € [0,23] and T (02) = 10. Black lines correspond to stable solutions 
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are denoted by 'H' (Hopf), 'P[n]' (period doubling), and 'F[n]' (fold). The ordinate measures 
the norm |x| and the inset shows the period along the main branch. Red crosses indicate the 
observed solutions from chart (b). (b): 50 random realizations of single delays which keep constant 
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standard deviation are indicated by squares and bars. For each choice of delays, constant initial 
functions were drawn from a uniform distribution on [0, 1.5]. The inset bars indicate the number 
of observed solutions x {t), t € [10^, 1.1 x 10^], with the norm |x| in their base interval. Chart (c) 
shows the trace and reappearances of the Hopf bifurcations in the T (ci)-T (c2)-plane. 

[4] T.-W. Ko and G. B. Ermentrout, Phys. Rev. E 76, 056206 (2007). 

[5] D. J. Bakkum, Z. C. Chao, and S. M. Potter, PLoS ONE 3, e2088 (2008). 

[6] R. Vicente, S. Tang, J. Mulct, C. R. Mirasso, and J.-M. Liu, Phys. Rev. E 73, 047201 (2006). 

[7] O. D'Huys, R. Vicente, T. Erneux, J. Danckaert, and I. Fischer, Chaos 18, 037116 (2008). 

[8] A. L. Franz, R. Roy, L. B. Shaw, and I. B. Schwartz, Phys. Rev. E 78, 016208 (2008). 

[9] S. Yanchuk, P. Perlikowski, O. V. Popovych, and P. A. Tass, Chaos 21, 047511 (2011). 

[10] O. V. Popovych, S. Yanchuk, and P. A. Tass, Phys. Rev. Lett. 107, 228102 (2011). 



9 



[11] C. E. Carr, Annu. Rev. Neurosci. 16, 223 (1993). 

[12] T. Erneux, Applied Delay Differential Equations, vol. 3 (Springer, 2009). 

[13] J. Foss, A. Longtin, B. Mensour, and J. Milton, Phys. Rev. Lett. 76, 708 (1996). 

[14] G. Giacomelli and A. Politi, Phys. Rev. Lett. 76, 2686 (1996). 

[15] V. Flunkert, S. Yanchuk, T. Dahms, and E. Scholl, Phys. Rev. Lett. 105, 254101 (2010). 
[16] S. HeiUgenthal, T. Dahms, S. Yanchuk, T. Jiingling, V. Flunkert, I. Kanter, E. Scholl, and 

W. Kinzel, Phys. Rev. Lett. 107, 234102 (2011). 
[17] J. K. Hale and S. M. Tanaka, J. Dyn. Differ. Equ. 12, 1 (2000). 

[18] I. Kanter, M. Zigzag, A. Englert, F. Gcissler, and W. Kinzel, Europhys. Lett. 93, 60003 (2011). 
[19] G. V. der Sande, M. C. Soriano, I. Fischer, and G. R. Mirasso, Phys. Rev. E 77, 055202 
(pages 4) (2008). 

[20] P. Perlikowski, S. Yanchuk, O. V. Popovych, and P. A. Tass, Phys. Rev. E 82, 036208 (2010). 
[21] P. Baldi and A. Atia, IEEE Transactions on Neural Networks 5, 1045 (1994). 
[22] J. K. Hale and S. M. V. Lunel, Introduction to Functional Differential Equations (Springer- 
Verlag, 1993). 

[23] L. Liicken, J. Pade, K. Knauer, and S. Yanchuk, in preparation (2012). 

[24] R. Diestel, Graph Theory (Springer, 2010). 

[25] M. G. Mackcy and L. Glass, Science 197, 287 (1977). 

[26] L. Appeltant, M. G. Soriano, G. Van der Sande, J. Danckaert, S. Massar, J. Dambre, 

B. Schrauwen, G. R. Mirasso, and I. Fischer, Nat. Commun. 2 (2011). 
[27] P. Glendinning and C. Sparrow, J. Stat. Phys. 35, 645 (1984). 



10 



